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1.1 Introduction 

As discussed in several chapters of this volume, frustration leads to unconven- 
tional (insulating) ground states. On the other hand doped holes are known 
to have profound effects in Mott insulators. Therefore doped frustrated sys- 
tems offer the prospect of novel phases with some of the most fascinating, 
challenging and exotic behaviour. In addition, at commensurate electron fill- 
ings and in the presence of strong (screened) Coulomb repulsion, geometrical 
frustration can also manifests itself as an extensive degeneracy of the clas- 
sical ground-state manifold providing profound similarities with the field of 
quantum frustrated magnetism. 

Magnetic frustration in quantum spin systems leads frequently to the for- 
mation of spin singlets (dimers). Generically, systems of fluctuating quantum 
dimers can often order, breaking lattice symmetries to give rise to Valence 
Bond Crystals (VBCs) [1], but under other circumstances they may remain 
in a quite unconventional quantum disordered state, the spin liquid, which 
breaks neither spin nor lattice symmetries. Anderson's original d-wave Res- 
onating Valence Bond (RVB) state [2] is a paradigm for the spin liquid (in 
fact, for a particular type of gapless spin liquid, while the short-range RVB 
state composed of only nearest-neighbor dimers is gapped spin liquid). In a 
number of cases, frustrated spin systems and/or dimer systems can be doped, 
for example by chemical substitution in a Mott insulator. When both spin 
and charge degrees of freedom are present, the role of frustration becomes un- 
clear, and to date remains only poorly explored. It is, however, clear that new 
and exotic phenomena emerge upon doping, including heavy-fermion behav- 
ior, spin-charge separation or quasiparticle fractionalization, unconventional 
superconductivity, stripe formation, bond and/or charge ordering, and many 
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others. Such fundamental issues have motivated an increasing number of re- 
cent investigations, as well as the continuing search for new, doped materials. 

In this chapter, we describe some selected topics which illustrate the rich- 
ness and diversity of the field of doped, frustrated magnets. The first ex- 
ample concerns the dynamics of a small number of doped holes in the two- 
dimensional (2D) kagome and checkerboard Hcisenberg quantum antifcrro- 
magncts. Without doping, the kagome Hcisenberg antifcrromagnet is believed 
to be a serious candidate for spin-liquid behavior, while the checkerboard lat- 
tice is the 2D analog of the well-known and highly frustrated 3D pyrochlore 
structure common in real materials. With doping, issues such as particle frac- 
tionalization and pairing can be addressed. In a second example, we move 
to the topic of Quantum Dimer Models (QDMs), similar to those proposed 
by Rokhsar and Kivelson in the context of the pseudo-gap phase of high- 
temperature superconductors. Two classes of (weakly) doped QDMs will be 
discussed, which differ in the assumed statistics, bosonic or fermionic, of the 
bare holes. We proceed further by considering strongly correlated electrons on 
frustrated triangular lattices, and discuss the physics of an unconventional, 
reentrant metal-insulator transition. As our final example, we consider corre- 
lated fcrmions moving on frustrated lattices at special, commensurate densi- 
ties for which exotic but once again insulating ground states (GSs) are stabi- 
lized. For systems with strong interactions (Mott insulators), we show briefly 
how their behavior is analogous to the physics of (undoped) QDMs. 

1.2 Doping holes in frustrated quantum magnets 
1.2.1 The holon-spinon deconfinement scenario 

We begin our discussion of the phenomena associated with doped holes in 
frustrated magnets by considering the most popular paradigm for a nonmag- 
netic quantum ground state, which is a dimer-based system. If we assume 
that a single hole is "injected," then the removal of the electron results in the 
breaking of one of the dimers, leaving behind an empty site (holon) and a free 
spin (spinon) on the same bond. 

If the dimers can change their positions by quantum fluctuations, the holon 
and the spinon can move on the lattice, across the diagonals of the plaquettes 
in a square-lattice system, by exchanging with the dimers. A typical configura- 
tion is shown in Fig. 1.1. Optimization of their kinetic energies would require 
the holon and spin to delocalize, and thus to become separated. In a (gapped) 
spin liquid, realized if the system can fluctuate through all possible dimer cov- 
erings, a complete separation, known as "deconfinement," is possible. In this 
situation, the Landau quasiparticle (QP) breaks apart into separate species, 
and an experimental technique which probes the hole Green function, such 
as Angle- Resolved Photoemission Spectroscopy (ARPES), would then show a 
broad maximum in place of the sharp QP peak. However, if dimer VBC order 
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Fig. 1.1. Schematic representation of a holon (empty site, red) and a spinon (free 
spin, green) embedded in a fluctuating background of bond singlets (black) . 

is present, i.e. only one specific (type of) covering lies lowest in energy, one 
expects an effective string potential that binds the holon and spinon: indeed, if 
the dimers had no internal structure, an attempt to separate these two "parti- 
cles" would lead to a continuous and linear increase of their energy. In reality, 
this increase is bounded by the spin gap (the energy to break up a dimer), 
beyond which which pairs of spinons would be generated spontaneously along 
the string. 

1.2.2 Single hole doped in frustrated Mott insulators 

Frustrated magnets are good candidates for the observation of spin-charge 
separation upon doping. The checkerboard and kagome lattices, shown in 
Figs. 1.2(a) and (c), are good examples of the types of frustrated lattice on 
which such a phenomenon may be expected. They are composed, respectively, 
of strongly frustrated tetrahedra and triangles, assembled in a 2D, corner- 
sharing structure. While the AF Heisenberg Hamiltonian for S = 1/2 spins (in 
this chapter we consider only systems of S — 1/2 spins) on the checkerboard 
lattice is now thought to be a fully gapped system exhibiting VBC order 
(plaquctte phase) [3-6], by contrast no sign of ordering has been found in 
the undoped kagome antifcrromagnet [7,8], which possesses an exponentially 
large number of singlet states within the (finite-size) spin gap [8,9]. It is 
these unconventional, low-lying excitations which open the door to new and 
surprising phenomena upon hole doping. 

We perform exact diagonalization (ED) calculations based on the standard 
t-J model Hamiltonian, 

m-j = -tJ2 v ( c *> c ;> + h - c -) v ■ -'Y, ::S <- H ' ( L1 ) 

{i,j),<r (id) 

where on both lattices all bonds have the same couplings t, describing the ki- 
netic energy of the hopping quasiparticlcs, and J, which is the superexchangc 
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Fig. 1.2. (a) Checkerboard lattice. The two degenerate VBC GSs of the nearest- 
neighbor Heisenberg model (half-filling) are represented schematically in blue and 
red. This figure also serves as a representation of the RSPC GSs of the quarter- 
filled, large-V Hubbard model of Subsection 1.5.2. (b) Full Brillouin Zone (BZ) of 
the checkerboard lattice. The dotted line corresponds to the reduced BZ associated 
with the y/2 x y/2 super-cell reflection. The path from the zone center (F) to the 
k = (n, 7r) point (M) is shown as a dashed line, (c) Kagome lattice, (d) As in (b) 
but for the case of the kagome lattice. 



interaction between the spins. This model is believed to be a reliable descrip- 
tion of the low-energy physics of weakly doped Mott-Hubbard insulators with 
large optical excitation gaps. Here and hereafter, we assume the value J = 0.4 
(in units where \t\ is set to 1), which is the general order of the physical value 
in a number of real materials. The hole spectral functions are defined in the 
standard way as 



ACk,u)) = Im 

7T 



(1.2) 



and calculated by Lanczos ED, supplemented with a continued- fraction tech- 
nique, on finite clusters with periodic boundary conditions to take advantage 
of the lattice translation symmetry The reader is referred to the chapter of A. 
Lauchli in this volume for a detailed discussion of numerical methods. Here 
we focus on the case of a single dynamic hole, as studied in Ref. [10]. Because 
of the absence of particle-hole symmetry in frustrated lattices, it is necessary 
to distinguish between the cases t > and t < 0. Note that for t < 0, frustra- 
tion can also appear in the hole motion: in the example of a particle with the 
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tight-binding dispersion on an isolated triangle, the kinetic-energy gain is |t|, 
a factor of two smaller than for t > 0. 




co/t co/ltl 

Fig. 1.3. Single-hole spectral functions obtained on a 32-site checkerboard cluster 
(V^2 x ^/32, tilted at 45° to the axes of Fig. 1.2) along the line FM. Left panel: 
t = +1; right panel: t — —1. In both cases, J/\t\ = 0.4. When a quasiparticle peak 
is present, the corresponding weight is indicated. Magnification factors applied in 
some cases are as indicated. From Ref. [10]. 

Typical results obtained for a 32-site cluster on the checkerboard lattice are 
shown in Fig. 1.3 for the line FM line in the Brillouin Zone (BZ) [Fig. 1.2(b)]. 
At all points, most of the spectral weight is found to be incoherent, distributed 
over a range of 7-9|f|. However, a small QP peak is visible, particularly for 
momenta close to the M point. The region close to the r point has only a 
very small QP peak, or possibly none at all, and the shape of the spectral 
function at r itself is very special, probably because of its higher point-group 
symmetry. 

The analogous spectral functions of the kagome lattice, shown in Fig. 1.4, 
show definite exotic behavior; they are very broad for all momenta (widths 
approximately 6-8|£|) and, in contrast to the checkerboard lattice, show no 
visible QP peaks, either for t > (left panel) or for t < (right panel). We 
stress that the broad appearance of these spectra has no connection to the 
value of r\ used in the calculation, but is an intrinsic feature of the spectral 
function, as can be deduced from the large number of poles carrying spectral 
weight (circles in Fig. 1.4). These spectral- function data support very strongly 
a spin-charge-separation scenario for the kagome lattice. Indeed, this spectac- 
ular phenomenon can be observed directly in the spin-density profile in the 
vicinity of the hole: a repulsion between the net 5=1/2 moment and the 
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mobile hole is clearly visible, providing further support to the deconfmcmcnt 
scenario described above in the context of dimer-based systems. 




Fig. 1.4. Single-hole spectral functions (black lines) along the line F *-* M, com- 
puted on a 27-site kagome cluster for t = +1 (left panels) and t = — 1 (right panels). 
Contributions of both singlet and triplet final states are included (see text). The red 
circles denote pole locations and their residues. From Ref. [10]. 

This investigation provides the first example of the observation of spin- 
charge separation in a 2D microscopic model, ft establishes that the spin-liquid 
nature of the undoped ground state is crucial for such behavior. Indeed, in the 
checkerboard lattice, whose ground state exhibits a VBC structure, a weak 
holon-spinon confinement manifests itself as QP peaks in the spectral function 
for some momenta. 

1.2.3 Hole pairing and superconductivity 

Whether doped holes could pair and lead to unconventional superconduct- 
ing behavior is another of the fundamental issues raised recently by the new 
prospect of doping frustrated antiferromagnets. Indeed, superconductivity in 
the spinel oxide LiTi 2 04 [11], in the recently synthesized 5c? transition-metal 
pyrochlores [12], and in a layered triangular CoO compound [13] suggests that 
geometrical frustration, which could be magnetic and/or kinetic, might play a 
key role in the mechanism of unconventional superconductivity (as discussed 
in the chapter of Z. Hiroi and M. Ogata). 

Cluster calculations (Fig. 1.5) were used to discover the occurrence of 
pairing in the doped checkerboard Heiscnberg antifcrromagnet described 
above [14]. It was shown that pairing, in several orbital channels including 
s- and d-wave, appears at arbitrarily small J/t for the particular sign of the 
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Fig. 1.5. Binding energies Eb (in units of \t\ = 1) of two holes doped on a square, 
32-site cluster (\/^X\/32) for t > and t < 0, in the two orbital-symmetry channels 
corresponding to the respective GSs. The thick, red line corresponds the local slope 
at J/t — > 0. Red arrows show the large kinetic-energy gain and small loss in magnetic 
energy whose sum gives Eb- Eb < is the signature of a bound state. From Ref. [14]. 

hopping amplitude which leads to frustration in the motion of a single hole. In 
fact, hole dclocalization (i.e. a gain in kinetic energy) plays a key role in this 
new mechanism of unconventional pairing, as also in some of the inter-layer 
tunneling mechanisms proposed by Anderson [15]. From these numerical data, 
a simple scenario might be proposed for t > 0: despite its suppressed coherent 
motion, a single hole retains a strong incoherent motion, and thus can act to 
"melt" the plaquette VBC in its vicinity. This region, which may be some- 
what extended in space, becomes more favorable for a second hole to gain 
kinetic energy, leading to correlated (or assisted) hopping. It is interesting 
to emphasize here the similarities with tight-binding studies of frustrated lat- 
tices, which show both localized single-particle states and interaction-induced, 
dclocalizcd, two-particle bound states [16]. 

In connection with cobaltates, superconductivity has also been investi- 
gated in the t-J model on the triangular lattice, in particular using RVB 
variational Ansiitze (presented in the chapter of Z. Hiroi and M. Ogata). In 
these studies, d x 2_ y 2 + id xy -wave superconductivity is found to be stable near 
half-filling. The relationship between this phase and the thrcc-sublatticc, 120- 
degree AF long-range order occuring at half-filling remains at present unclear 
and in need of further investigation. 
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1.3 Doped Quantum Dimer Model 
1.3.1 Origin of the Quantum Dimer Model 

The conclusions obtained in Sec. 1.2.2 notwithstanding, both magnetic frus- 
tration and the introduction of fermionic variables (holes) lead, together or 
independently, to severe limits on the available numerical approaches. For ex- 
ample, quantum Monte Carlo algorithms, known to be very efficient for simple 
quantum spin systems, suffer from the infamous "minus-sign problem" (intro- 
duced in the chapter of A. Liiuchli) and cannot be used at the required low 
temperatures. Practically, zero-tcmpcraturc ED (by the Lanczos algorithm) 
and variational approaches are the only controlled methods practicable for 
systems such as the t-J model on frustrated lattices. However, one alterna- 
tive route to the investigation of microscopic models of the t-J and Hubbard 
types is to construct effective models which would allow the use of more effi- 
cient methods, or calculations on larger clusters, while retaining the essential 
low-energy physics. 




Fig. 1.6. (a) Dimer-exchange process and (b) holon hopping process in the QDM. 



When the effect of magnetic frustration is such that dimer degrees of free- 
dom are relevant, one may consider the quantum hard-core dimer gas on a 
two-dimensional lattice. We illustrate this type of model by considering a 
square lattice, on which it is defined by the Hamiltonian 

H Q um = VJ2 n c\c)(c\-JY1 l c '){c|, (1-3) 

c (c.d) 

where the sum over the index (c) refers to all nearest-neighbor dimer cover- 
ings, N c is the number of "exchangeable" plaqucttcs, and the sum (c', c) is over 
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all pairs of configurations |c) and |c') that differ by a single dimcr-cxchangc 
process of the type illustrated in Fig. 1.6(a). In a manner similar to the square 
lattice, on the triangular lattice the exchange of parallel dimcr pairs can be 
performed on the three different types of two-triangle rhombi. This model was 
introduced originally by Rokhsar and Kivelson [17] in the context of the RVB 
theory of cuprate superconductors. The connection to the original spin formu- 
lation is, however, not completely clear: among other truncations of the spin 
degrees of freedom, the QDM of Eq. (1.3) deals by construction with orthog- 
onal dimer coverings, which is not the case for the SU(2) dimer basis relevant 
in frustrated Heisenberg antiferromagnets. In spite of these subtleties, QDMs 
are expected to capture the essential physics of systems with singlet ground 
states, one primary reason for this being that they do possess the extreme 
ground-state degeneracy of the basis manifold. More details concerning these 
issues may be found in the chapter of R. Moessner in this volume. 

It is easy to introduce doping in the QDM. Holes may be injected only in 
pairs (i.e. by removing dimers). However, doped holes can then move inde- 
pendently by hopping between nearest-neighbor (on the triangular lattice) or 
diagonal next-nearest-neighbor (on the square lattice) sites [17-19]. The full 
Hamiltonian for a doped QDM is 

H = H QBM -t ]T |c")(c|, (1.4) 

(c,c") 

where the (c",c) sum involves all pairs of configurations |c) and |c"), con- 
taining a fixed number Nh of vacant sites (holes) , that differ by a single hole 
hopping along a plaquettc diagonal as illustrated in Fig. 1.6(b). In this for- 
mulation, bare holons, by which is meant the moving vacancies, have Bosc 
statistics. Note that, in contrast to the triangular lattice, holes on the square 
lattice are constrained to remain only on one of the two sublattices. 
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Fig. 1.7. Schematic phase diagrams of the undoped QDM for both the triangular 
(top) and square (bottom) lattices. Only the triangular lattice is believed to exhibit 
a liquid (RVB) phase. Evidence for the mixed phase on the square lattice has been 
reported in Ref. [23]. 
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1.3.2 Phase diagrams at zero doping 

Somewhat remarkably, the square- and triangular-lattice QDMs have quite 
different phase diagrams in the undoped case. First, exactly at V = \J\, which 
is known as the "RK point," the GS takes the form of an equal superposition 
of all dimer coverings, and exhibits algebraic dimer correlations on the square 
lattice but short-ranged (exponentially decaying) correlations on the trian- 
gular lattice. Ordered VBC states appear on the square lattice immediately 
away from the RK point, whereas a gapped RVB liquid [20] is present over a 
finite region in VJ J on the triangular lattice. This RVB phase of the triangular 
lattice has also been shown to exhibit topological order [20,21], whose impor- 
tance for frustrated systems is discussed in the chapter of G. Misguich, and 
for quantum information in the chapter of J. van den Brink, Z. Nussinov and 
A. M. Oles. Comparative schematic phase diagrams for the two lattices are 
depicted in Fig. 1.7. The square lattice shows a rich variety of VBC phases [22] 
with, in particular, a novel mixed phase [23] which interpolates between the 
columnar and the plaquette phases (the blue squares in Fig. 1.7 correspond 
to plaquettes on which vertical and horizontal dimer pairs resonate). 

1.3.3 Connection to the XXZ magnet on the checkerboard lattice 

We have already explained the extent to which QDMs provide a natural frame- 
work to describe the dynamics of SU(2) singlets in frustrated but isotropic 
quantum antifcrromagnets. We also mention briefly another case in which the 
QDM emerges as the model for the low-energy physics, that of the strongly 
anisotropic Heisenberg magnet (in the Ising limit) on the checkerboard lattice 
and in the presence of a magnetic field. 

We begin with no magnetic field and only an Ising coupling, J z Sf Sj, on 
the bonds of the checkerboard lattice: in this case, the (classical) ground state 
is highly degenerate and can be fully represented by the "loop coverings" illus- 
trated in Fig. 1.8(a). Here, an up- (down-)spin is represented by the presence 
(absence) of a dimer, or boson, on the bonds of an effective square lattice 
whose sites are in fact the centers of the "tetrahedra" (the squares including 
diagonal bonds). The constrained nature of the classical GS is of the "ice-rule" 
type: the lowest Ising energy is obtained when there are precisely two bosons 
on every tetrahedron. Second-order processes in the exchange coupling J xy 
lead to the dynamics of a six- vertex model [24] or a quantum loop model [25]. 

By applying a magnetic field, the density of dimers (bosons) can be altered 
systematically. When an average of one dimer per tetrahedron is reached, 
again the ground-state manifold obeys an ice-rule constraint in the large- J z 
limit, where all states with precisely one dimer on every tetrahedron, as shown 
in Fig. 1.8(b), are ground states. Second-order processes in J xy now lead to a 
QDM on the effective square lattice with V = and J = J xy /Jz in Eq. 1.3. 
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(a) Mz=0 (b) Mz=l/2 

Fig. 1.8. Representation of the Hilbert space of the large- J z XXZ Heisenberg model 
on the checkerboard lattice in terms of (a) loop and (b) dimer coverings, correspond- 
ing respectively to (a) zero magnetization and (b) M z = ±1/2. The red dots repre- 
sent hard-core bosons with, for example, S z = 1/2 on the corresponding sites, while 
all other sites have S z — —1/2. A dimer joining the centers of two "tetrahedra" is 
associated with each boson. 



1.3.4 Bosonic doped Quantum Dimer Model 

We turn now to the doped QDM and concentrate first on the case J > in 
Eq. 1.4. In the mapping from SU(2) dimers, this sign of J is expected for a 
bosonic representation of the singlet bonds. The "monomers" (holes) of the 
doped QDM discussed here could then be interpreted physically as entities 
such as unbound spinons. 




(a) J>0 lt/IJ=0.5 (b) j>o v=o 

Fig. 1.9. Schematic phase diagrams of the bosonic doped QDM as a function of 
dopant concentration x and V/J (a) or J/\t\ (b). Accurate GFMC data are obtained 
for V/J — > 1 and at moderate \t\/J ratios (as explained in Ref. [19]). 
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For J > and t > 0, the off-diagonal matrix elements of the Hamiltonian 
(1.4) are all non-positive, so that (from the Perron-Frobcnius theorem) its 
GS has no node. Consequently, Green-function Monte Carlo (GFMC) tech- 
niques can be applied, particularly in the vicinity of the RK point and for 
small t/J ratios (i.e. when the exact RK GS is still a good guiding wave 
function), and the phase diagrams shown in Fig. 1.9(a,b) can be extracted 
by appropriate finite-size scaling. For larger values of t/J, such calculations 
can be complemented by ED on smaller clusters [26]. The phase-separation 
(PS) region consists of phase coexistence between an undoped VBC and a 
superfluid, the latter becoming stable as a unique component above a critical 
doping. It is notable that this superfluid exhibits flux quantization in units 
of h/2e, in qualitative agreement with gauge theories of high-temperature 
superconductors [27] and recent, related Z 2 gauge theories [28]. 




Fig. 1.10. Schematic phase diagrams of the non-Frobenius (J < 0) doped QDM as 
a function of dopant concentration x and V/\ J\ (a) or | J/t\ (b), estimated by ED 
calculations [26]. 



1.3.5 Non-Frobenius doped Quantum Dimer Model on the square 
lattice 

Turning to the case of Eq. 1.4 with J < 0, a quite different type of behavior 
is expected. The "non-Frobenius" nature of the Hamiltonian (which prohibits 
the use of GFMC) reflects the original "Fermi sign" of the strongly corre- 
lated electrons. Indeed, if one interprets the dimers as SU(2) singlets, a dimer 
creation operator on the bond ij can be written in the fermionic representa- 
tion [29,30] as d\j = (f^fji + /Jj fj^ )/ V%- In this basis, it can be verified that 
the effective dimer-exchange process generated by the underlying Heisenbcrg 
interaction within a plaquette occurs for the sign J < [29]. In addition, 
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the electron-destruction operator takes the form c !(T = fi a b], where the holon 
(hole or monomer) -creation operator b\ is bosonic. 

The phase diagram of the non-Frobenius doped QDM obtained by ED [26] 
is both exotic and rich, as shown in Fig. 1.10. First, bare holons can be seen 
binding to topological defects (namely vortices, also known as "visons"), pro- 
ducing fcrmionic composite particles; alternatively stated, the hole becomes a 
fcrmion. Secondly, in contrast to the bosonic case, no PS is seen in the immedi- 
ate vicinity of the (VBC) Mott insulator. Instead, a d-wave pairing is expected, 
opening the possibility of unconventional superconductivity. Finally, at large 
kinetic energies, holons and vortices unbind, bosonic holes Bose-condense, and 
a superfluid phase is stabilized, presumably of the same type (with 2e charge 
quanta) as that obtained for J > 0. 

1.4 Mott transition on the triangular lattice 

1.4.1 Frustration in itinerant electron systems 

In the first half of this chapter, we have discussed the dynamics of holes doped 
into magnetic insulators with geometrical frustration. Another important class 
of phenomena is driven by frustration in metallic systems. Several strongly 
correlated metallic systems, such as L1V2O4 [31] and (Y,Sc)Mn 2 [32], show 
unusually large entropies at temperatures much lower than their bare energy 
scales (band width and Coulomb repulsion), and this is thought to be related 
to the geometrical frustration inherent in their lattice structure [33,34]. In 
strongly correlated electron systems, double occupancy of a site is suppressed 
by the large, on-site Coulomb repulsion, and the probability of single occu- 
pancy increases. This tends to enhance the formation of a local magnetic mo- 
ment at each site, which interacts with neighboring moments, and frustrated 
configurations may be adopted depending on the lattice geometry. The central 
issues for frustrated metals are the effects of exotic magnetic fluctuations on 
quasiparticle coherence and novel magnetic long-range order or characteristic 
correlations in itinerant systems. 

1.4.2 Mott transition in organic compounds with triangular 
geometry 

One of the well-studied problems in the physics of frustrated metals is the Mott 
metal- insulator transition on a triangular lattice [35-37] . When the Coulomb 
repulsion is much larger than the band width (U W), the half-filled system 
is described effectively by the Hcisenbcrg spin model in the sector of ener- 
gies below the Mott-Hubbard charge gap. In this case, the well-known 120° 
structure appears in the ground-state spin configuration. A more exotic sit- 
uation can be expected when the Coulomb repulsion is comparable with the 
band width (U ~ W), when ring-exchange processes involving multiple sites 
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become important. These processes, which are discussed in the chapter by G. 
Misguich, open the possibility of stabilizing exotic states. 

Experiments on organic compounds with a triangular lattice structure 
[38-40] have stimulated theoretical studies on the triangular-lattice Hubbard 
model. These materials are quasi-two-dimensional k-(ET)2X systems with 
several possible monovalent anions X. ET denotes the bis(ethlylcncdithio)- 
tetrathiafulvalcne molecule, also often represented as BEDT-TTF, and dimer- 
ized pairs of ET molecules constitute a triangular lattice. Each pair provides 
one conduction electron, and the system is well described by a half-filled Hub- 
bard model on the triangular lattice with nearest-neighbor hopping terms, 

(id) a h a 4 

Here n ?(T = cj^c^ and, because this model lacks electron- hole symmetry, the 
chemical potential /i is introduced to adjust the electron density to half filling, 
^2 a ( n io-) — !■ The organic ET compounds have in fact only intermediate cor- 
relation strengths: because each site in the model represents a pair of molecules 
and the corresponding Wannier wave function is extended over the size of this 
pair, the Coulomb repulsion U is smaller than in the case of typical inorganic 
compounds, and as a result charge fluctuations have important effects. Be- 
cause of the non-spherical shape of the molecule pairs, there are two different 
hopping integrals between nearest-neighbor sites, t and t' [Fig. 1.13(a)]. The 
ratio t'/t depends on the anion species X, and is an important parameter 
controlling the frustration. 




P (MPa) P (MPa) 

Fig. 1.11. Temperature-pressure phase diagram of (a) k-(ET)2Cu2CN3 and (b) 
k-(ET)2Cu[N(CN)2]C1. PM: paramagnetic metal, PI: paramagnetic insulator, AFI: 
antiferromagnetic insulator, SLI: spin-liquid insulator, SC: superconducting phase. 
Reproduced based on Refs. [39] and [40]. 



Extensive investigation of the ET systems [38-40] has demonstrated that 
their low-energy magnetic properties change dramatically for different anions 
X. Particular highlights in the series include spin- liquid-like behavior in k- 
(ET)2Cu2CN3 [39] and a reentrant metal-insulator transition with decreasing 
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temperature at intermediate pressures in k-(ET) 2 Cu[N(CN) 2 ]C1 [40]. The dif- 
ference between these systems lies in the different values of the frustration pa- 
rameter t' It. Quantum chemistry calculations estimate that t' jt = 1.06 for k- 
(ET) 2 Cu 2 CN 3 and 0.75 for k-(ET) 2 Cu[N(CN) 2 ]C1 [38]. From the viewpoint of 
their electronic structure, the candidate spin-liquid material k-(ET) 2 Cu 2 CN 3 
is very close to being a regular triangular system, in which all the hopping in- 
tegrals are the same, while the reentrant material k-(ET) 2 Cu[N(CN) 2 ]C1 cor- 
responds to a triangular geometry perturbed towards an unfrustrated square 
lattice. 

Figure 1.11 shows the temperature-pressure phase diagrams of these two 
compounds. In these systems, the primary effect of applying pressure is to 
increase the hopping integrals, and thus the region of higher pressure in ex- 
periments corresponds to smaller values of U/W in the Hubbard model. The 
boundaries between the metallic and insulating phases in the two materials 
differ qualitatively in shape: in k-(ET) 2 Cu 2 CN3, the insulating phase appears 
on the high-temperature side of the boundary; in k-(ET) 2 Cu[N(CN) 2 ]C1, this 
is only the case above approximately 30 K, while below this the insulating 
phase extends as the temperature decreases. The former type of behavior is 
beyond the naive expectation that electron dynamics become more coherent 
with decreasing temperature, but it is consistent with the conventional Mott 
transition, as we explain in detail in the next subsection. 




pressure pressure 



Fig. 1.12. Phase diagram of the Hubbard model determined by dynamical mean- 
field theory: (a) single-site approximation and (b) results obtained when considering 
the possibility of AF long-range order, corresponding to an unfrustrated lattice. The 
dotted line marks the metal-insulator transition when magnetic order is absent. The 
same acronyms are used for labelling the phases as in Fig. 1.11. (c) Schematic illus- 
tration of the electron spectral function at the Mott transition, shown for different 
values of U/W (1 -> 4). 



1.4.3 Mott transition in the triangular-lattice Hubbard model 

A schematic phase diagram of the "frustrated" Hubbard model is shown in 
Fig. 1.12(a). There is a first-order phase transition separating metallic and 
insulating phases. As U/W is increased, spectral weight is transferred from 
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the region around lu = to the lower and upper Hubbard bands at to ~ ±U 
[Fig. 1.12(c)]. The central peak disappears at the transition point and the 
insulating phase is on the high-temperature side of the boundary. The model 
is frustrated in the sense that these results arc obtained from a single-site, 
dynamical mean-field theory [41], which assumes the absence of a magnetic 
instability and thus describes well the case of strong frustration; the phase 
diagram shows a line of Mott transitions in the original sense of this term, 
meaning transitions occurring with no simultaneous magnetic order. In the 
insulating phase, each site has a finite static magnetic moment, which is effec- 
tively decoupled from the surrounding moments, and this leads to a large spin 
entropy of order log 2. This is the reason that the insulating phase is stabilized 
at higher temperatures. In unfrustrated systems, as shown in Fig. 1.12(b), the 
metal-insulator transition takes place simultaneously with the emergence of 
AF long-range order, and the genuine Mott transition does not occur. 



(o) 






m—fl 




















0.95 



1.00 1.05 

u/w 



1.10 



Fig. 1.13. (a) Generalized triangular lattice with two types of nearest-neighbor 
hopping integrals, t and t' . The case t — t' corresponds to the regular triangular 
lattice, (b) Phase diagram of the anisotropic, triangular lattice with t' = 0.8t. 



Wc now return to the mysterious reentrant metal-insulator transition 
in k-(ET) 2 Cu[N(CN) 2 ]C1. This problem was investigated in Rcf. [42] by 
studying the half-filled Hubbard model on an anisotropic, triangular lattice 
[Fig. 1.13(a)] with t' = 0.8t, to determine the U-T phase diagram using cellu- 
lar dynamical mean-field theory (CDMFT). This method is a generalization of 
the conventional dynamical mean-field theory which uses a cluster of multiple 
sites (four for this system) [43], and allows one to calculate electronic Green 
functions and different correlation functions in addition to thermodynamic 
quantities at finite temperatures. The CDMFT approach has the advantage 
that both quantum and thermal fluctuations, and thus frustration effects, are 
taken into account completely inside the cluster. 

The phase diagram of the anisotropic, triangular-lattice Hubbard model 
is shown in Fig. 1.13(b). The band width at U = 0, W = 8A5t is taken as the 
unit of energy. The phase diagram was determined by analyzing the double 
occupancy D = (n^rt^), which is a measure of metallicity. In the metallic 
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and insulating phases identified in this way. D(T) decreases with decreasing 
temperature in the paramagnetic insulating (PI) phase, while it increases in 
the paramagnetic metallic (PM) phase. In the high-temperature regime, these 
two phases merge smoothly at the crossover line (dotted) , which is defined by 
the condition dD/dT = 0. In the low-temperature regime, the two phases are 
separated by a first-order transition, where the double occupancy shows an 
abrupt jump. 




Fig. 1.14. Wave vector-dependent electron spectral functions of the half- filled 
Hubbard model on an anisotropic, triangular lattice with t' = 0.8t and U/W = 
0.947. 

It is to be noted that reentrant behavior of the metal-insulator transi- 
tion/crossover is indeed found in the anisotropic, triangular-lattice Hubbard 
model for intermediate values, t'/t ~ 0.8, of the hopping ratio. The nature of 
this reentrant behavior is clearly visible in the wave vector-dependent electron 
spectral function Ak(u>), shown in Fig. 1.14 for three representative tempera- 
tures and at the fixed value U /W = 0.947. In the high-temperature PI phase, 
there is a wide Hubbard gap in the spectrum around w = 0. In the intermedi- 
ate PM phase, a heavy-quasiparticle band emerges in the Hubbard gap, a clear 
sign of metallic behavior and consistent with the conventional Mott transition 
depicted in Figs. 1.12 (a) and (c). However, the low-temperature, first-order 
transition line has a different character: the heavy-quasiparticle band does not 
disappear, splitting instead into two bands separated by a small energy gap, as 
shown in Fig. 1.14(c). This behavior is similar to the case of a metal- insulator 
transition driven by magnetic instability. 

This type of explanation is confirmed by calculations of the magnetic sus- 
ceptibility, x q [44], which has a peak at the incommensurate wave vectors 
Q w ±(0.77t, 0.77r). This peak grows as the temperature decreases, and di- 
verges at a finite temperature indicated by the crosses in the phase diagram 
of Fig. 1.13(b). The line of magnetic instability is very close to the first-order 
metal-insulator-transition line, and it is reasonable to expect that the metal- 
insulator transition is driven by enhanced magnetic fluctuations. It should 
also be noted that the two lines are separate and there exists a finite region 
of a paramagnetic insulating phase between them. 

To summarize this section, the anisotropic, triangular-lattice Hubbard 
model has a phase diagram showing a reentrant metal-insulator transition. 
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This phenomenon is a direct consequence of the effects of geometrical frustra- 
tion on magnetic correlations. Taking increasing pressure to reduce the ratio 
U / W, the calculated phase diagram reproduces qualitatively the essential fea- 
tures of the phase diagram of re-(ET)2Cu[N(CN)2]Cl. The finite values of the 
magnetic transition temperature in this 2D model are a consequence of the 
mean-ficld-type approximation made for inter-cluster correlations, but may 
provide an estimate of the true values which would be obtained on including 
the 3D couplings present in real materials. 

1.5 Ordering phenomena at commensurate fermion 
densities on frustrated geometries 

In the preceding sections we have discussed only correlated systems at or near 
half-filling (i.e. with one electron per lattice site). However, repulsive inter- 
actions with longer range than the on-site terms considered above can also 
give rise to insulating behavior at different commensurate densities. Exam- 
ples include quarter-filling and even 1/8-filling on the checkerboard lattice, 
and we illustrate this phenomenon here by discussing two scenarios occur- 
ing on frustrated geometries. One is a Bond-Order- Wave (BOW) instability 
is driven directly by particular nesting properties of the Fermi surface. The 
other concerns the effects of nearest-neighbor interactions sufficiently strong 
that they produce a novel type of Mott insulator exhibiting an exotic VBC 
order. The properties of this Mott insulator may be described by an effective 
QDM, hence providing a formal connection with Sec. 1.3. This latter insula- 
tor can also be doped, a point we mention briefly as a possible route towards 
quite new and exotic metallic and superconducting behavior. 

1.5.1 Bond Order Waves from nesting properties of the Fermi 
surface 

Let us consider the extended Hubbard Hamiltonian, H = Hq + H ln t, on the 
2D frustrated kagome and checkerboard lattices. We recall here that these 
lattices are composed of corner-sharing units (respectively triangles and tetra- 
hedra) residing on an underlying bipartite lattice (respectively hexagonal and 
square), a point which will be important in determining their behavior. The 
kinetic part of the Hamiltonian is given by 




(1.6) 



(ij) <7=TI 



with positive hopping matrix element t, and the sum Sfo) 
on the lattice. The interaction part is given by 



is over all bonds 




(1.7) 
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with on-site repulsion U, nearest-neighbor spin exchange J, and nearest- 
neighbor repulsion V; in this subsection, we consider the regime of weak and 
intermediate couplings. 

On kagome and checkerboard lattices, the non-interacting hamiltonian Hq 
exhibits a dispersionless (flat) band which, for t > 0, lies at the top of the 
spectrum and plays no role. For the kagome lattice, the band structure is 
remarkable for the presence of "Dirac cones" positioned exactly at the Fermi 
level of the 1/3- filled system (n = 2/3) and leading to semi- metallic behavior 
(also relevant on the 3D pyrochlore lattice). Renormalization-group and nu- 
merical techniques [45] have been applied to demonstrate that a spontaneous 
symmetry-breaking occurs for arbitrarily small interactions in this system: the 
instability corresponds to a BOW in which the kinetic energy is staggered for 
neighboring triangular units on the underlying hexagonal lattice. We stress 
that no charge modulation is present (so that all sites remain equivalent), 
the BOW breaking only the spatial site-inversion (180°) symmetry, such that 
up- and down-pointing triangles in Fig. 1.2(c) become different, while trans- 
lational symmetry is preserved [45]. 



CM 

j x i i X i 
*.'- . -* — . * 

Fig. 1.15. Bond Order Wave on the checkerboard lattice at n — 1/2. The four 
inequivalent bonds are represented by different colors/line types and by different 
thicknesses (diagonal and x/y bonds are different). All the sites (black dots) carry 
the same electron occupancy (1/2 electron on average). 



On the checkerboard lattice, a BOW instability appears at quarter-filling 
(n = 1/2). As on the kagome lattice, this BOW (Fig. 1.15) is character- 
ized by two types of (tetrahedral) unit with different kinetic (and exchange) 
energies. However, in the case of the checkerboard lattice, translation sym- 
metry is broken explicitly, although once again there is no charge order. This 
symmetry-breaking occurs because of perfect nesting of the square Fermi sur- 
face [46] . Alternatively, it can be physically understood as special, local (res- 
onant) states formed on the building units (the crossed plaquettes) when the 
filling is such that these are preferred; the occupation states of the units can 
also be considered to differ. This local picture is in fact fully equivalent to the 
nesting instability of the Fermi surface. 
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1.5.2 Metal-insulator transitions and frustrated charge order 

We consider next the strong-coupling limit, where at U = oo one obtains the 
Hamiltonian 



where V is the projection operator enforcing the single-occupancy constraint 
and V = V + J/4. For V = 0, the strong-coupling Hamiltonian reduces to 
the conventional t-J model. 

For simplicity, we restrict our considerations to the checkerboard lattice 
and state only that similar behavior can be found for the kagome lattice. Ex- 
amining first the limit V = oo for the special, commensurate filling n = 1/4 
(1/8-filling), the minimum "classical" energy (E = 0) is obtained for all config- 
urations fulfilling the "ice rule" of precisely one particle on every tetrahedron, 
as in Fig. 1.8(b). The full Hilbcrt space is then obtained from all possible 
ways of "decorating" all dimcrs with a spin index, i.e. the Hilbert space at 
n = 1/4 is exactly that of a two-color QDM [47]. A similar procedure, deco- 
rating the simple loop configurations of Fig. 1.8(a), can also be employed to 
construct the two-color loop configurations which constitute the constrained 
Hilbert space at quarter-filling (n = 1/2) in the large- V limit. It is then clear 
that, for these special fillings, the GS should be insulating at sufficiently large 
V. The effective dimer (or loop) dynamics can be obtained by perturbation 
in t/V. We note that in the original derivation [33], for spinless fermions, the 
lowest-order processes were of third order, whereas when spin degrees of free- 
dom are included, terms of dimer- exchange type (below) arise at second order 
in t. Although the constrained quantum dynamics of fermions without [33] 
and with [48,49] spin differ, the phase diagrams of these models contain a rich 
variety of crystalline phases, breaking lattice translational and/or rotational 
symmetry, in both cases. We postpone to Sec. 1.5.3 a discussion of the prop- 
erties of this type of system away from commensurate filling, and remark only 
that, among the novel phenomena which can arise, one of the more exotic is 
the fractionalization under some conditions of a single doped charge e into 
two e/2 components [33,50,51]. 

Let us now focus in more detail on the insulating phases and consider the 
effective Hamiltonian acting within the constrained Hilbert space as second- 
order processes preserving the ice rule. Here H = H a + Hj with 




(1.8) 




(1.9) 




(1.10) 



S 




(1.11) 



n=l/4 
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n=l/2 n=3/4 
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Fig. 1.16. Schematic representation of candidate plaquette (a) and columnar (b) 
phases of the checkerboard lattice for electron densities n = 1/4, 1/2, and 3/4, as dis- 
cussed in subsection 1.5.2. Dots, shaded plaquettes, and thick (red) lines correspond 
respectively to electrons, singlet pairs resonating on a plaquette, and resonating 
four-electron plaquette singlets. From Ref. [49]. 



where t2 = ^^ and the index s labels the empty plaquettes of the checker- 
board lattice (Fig. 1.2); the sites of a plaquette s are ordered as i, k,j, I in a 
clockwise (or anti-clockwise) direction. The operator P a (s) acts on two elec- 
trons forming a singlet bond on one of the two diagonals of s, to rotate this 
bond by 90 degrees. Candidate GSs breaking the translational symmetry of 
the lattice are shown in Fig. 1.16. For a quarter-filled band [n = 1/2), the 
Resonating-Singlct-Pair Crystal (RSPC) of Fig. 1.16(a) was shown to be sta- 
ble for J jt-i < 1 [48,49]. In the twofold-degenerate RSPC, electron pairs res- 
onate on every second empty plaquette, breaking translational symmetry One 
therefore expects, on increasing V/t and U /t, a first-order transition from the 
BOW state discussed above [46] to the RSPC. The same analysis also provides 
evidence [49] that the system exhibits plaquette order of the RSPC type also 
at n = 1/4 or n = 3/4, albeit with a quadrupling of the lattice unit cell (as op- 
posed to the doubling found for n = 1/2) and a fourfold-degenerate GS. Qual- 
itative differences between these models and their bosonic analogs, which are 
known for example to exhibit columnar order at n = 1/4 [25] , emphasize the 
important role of the spin degrees of freedom, not least in stabilizing plaquette 
phases over phases breaking the rotational symmetry. However, the possibil- 
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ity is being investigated [52] that mixed columnar-plaquctte phases, similar to 
one discovered recently in the square-lattice QDM [23] and which break both 
7r/2 rotational symmetry (as does the columnar phase) and translational sym- 
metry in two perpendicular directions (as does the plaquctte phase), could be 
stable in some simple and natural extensions of the Hamiltonian (1.10). 

1.5.3 Away from commensurability: doping the 
Resonating-Singlet-Pair Crystal 

Whether plaquette ordering of the RSPC type can survive at sufficiently low 
but finite hole (electron) dopant concentrations x = 1/2 — n (x = n— 1/2) 
remains unsettled. It has been shown [48] that phase separation, a generic 
feature of correlated systems in the vicinity of a Mott phase, is restricted 
to low hole kinetic energies, meaning to small t/J and t/t2 ratios, which 
leaves an extended regime over which unconventional superconducting pairing 
may occur. However, the phase diagram of these model for arbitrary electron 
densities remains largely unexplored, and can be expected to harbor further 
surprises. 

1.6 Summary 

The richness and diversity of systems of doped, frustrated magnets and of 
itinerant correlated electrons on frustrated lattices have been illustrated on 
selected didactic examples. The dynamics of a small number of doped holes has 
been investigated in the 2D kagome and checkerboard Heiscnberg quantum 
antifcrromagnets revealing striking differences attributed to the different na- 
ture of their non-magnetic GS. Two classes of (weakly) doped QDMs have also 
been discussed, which differ in the assumed statistics, bosonic or fermionic, of 
the bare holes. We have proceeded further by considering strongly correlated 
electrons on frustrated triangular lattices, and discuss the physics of an un- 
conventional, reentrant metal-insulator transition. Assuming that increasing 
pressure reduce on-site correlations, the calculated phase diagram reproduces 
qualitatively the essential features of the phase diagram of the molecular solid 
k-(ET)2Cu[N(CN)2]C1. As our final example, we consider correlated fcrmions 
moving on frustrated lattices at special, commensurate densities for which 
exotic insulating ground states (GSs) are stabilized. Interesting similarities 
with frustrated Heiscnberg magnets showing an extensive degeneracy of the 
classical GS manifold are outlined and are shown to be at the heart of their 
fascinating properties. 
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